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Achievement Effects of Embedded Multimedia 
In a Success for All Reading Program 

Abstract 

Embedded multimedia refers to teaching methods that embed video or DVD 
content within teachers’ lessons. The research of Mayer (2001) and others has suggested 
that multimedia instruction can enhance learning by using the capacity of both visual and 
verbal memory systems. The present study evaluated embedded multimedia in a year- 
long randomized clinical trial comparing first graders who learned beginning reading 
using the Success for All program (Slavin & Madden, 2001) either with or without 
embedded, brief video components. A study involving ten high-poverty schools in 
Hartford, CT found significant positive effects on the Woodcock Word Attack scale, 
controlling for pretests, in HLM analyses. The results support theoretical expectations. 
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For more than 50 years, educators and policymakers have been expectantly waiting for 
the video* revolution in education. Indeed, research on educational programs such as 
Sesame Street (Bogatz & Ball, 1971; Fisch & Truglio, 2000; Rice, Huston, Truglio, & 
Wright, 1990) and Between the Lions (Linebarger, Kosanic, Greenwood, & Doku, 2004) 
has shown positive effects of educational television for the reading and language 
development of young children. Yet video has remained a minor medium in the 
classroom, where it has been seen as a replacement for teacher instruction rather than a 
tool for teachers. 

In recent years, however, video has begun to appear in educational practice in a 
new form that has great potential for education reform. Video is one example of what 
Mayer (2001) calls “multimedia,” instructional formats that combine words and pictures. 
Instead of replacing instruction, multimedia can be embedded in classroom instruction to 
enhance teachers’ lessons. This “embedded multimedia” application is not widely known 
or used, but research on the practice has shown initial promise. In embedded multimedia, 
brief multimedia segments are threaded throughout teachers’ lessons. In one sense, 
embedded multimedia should at least share the impacts on achievement found in studies 
of the use of pictures, illustrations, diagrams, and other graphic content to enhance the 
effects of class lessons and text (see Schnotz, 2002; Shah, Mayer, & Hegarty, 1999; 
Carney & Levin, 2002; Vekiri, 2002). Yet well-designed embedded multimedia using 
video has properties that go beyond static graphics. First, video can model skills or 
content for students, giving them clear demonstrations of proficient performance. For 
example, videos can show children modeling advanced problem-solving strategies, 

* Throughout this paper, the term “video” is assumed to include DVD and CD formats as well as VHS 
unless otherwise noted. 
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sounding out words, thinking out loud about their creative writing, or working through a 
scientific investigation. Further, any multimedia that models for children also models for 
teachers, providing “just-in-time” professional development. For example, showing 
children working in cooperative groups to solve particular kinds of problems may provide 
teachers with a clear idea of what cooperative learning should look like, just as it would 
for students. 

Theoretical Background 

The theoretical basis for embedded multimedia begins with Paivio’s dual coding 
theory (Clark & Paivio, 1991), which demonstrated that information held both in verbal 
memory and in visual memory is retained better than information held in only one 
memory system. For example, Mayer (2001) and his colleagues carried out a series of 
experiments in which students were taught how lightning works. Teaching about 
lightning using narration alone or text alone teaches only to verbal memory. Adding 
diagrams or moving pictures to illustrate the concept teaches to visual memory. Adding 
the pictures to narration or text greatly increased initial learning of the concept, as well as 
both retention and transfer, as long as the pictures and text or narration were closely 
aligned with each other and focused on the instructional objective (Mayer & Moreno, 
2003). 

Another key concept in multimedia learning is cognitive load. It has long been 
known that working memory places a severe limitation on the amount of information that 
can be absorbed at any given time (Solso, 2001). Each learning objective has a given 
intrinsic cognitive load, and if this exceeds the working memory capacity of children of a 
given age or level of knowledge, the objective must be broken into components that “fit” 
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within the child’s working memory capacity (Paas, Renkl, & Sweller, 2003). However, 
each memory system has its own limitations, which may be fairly independent of one 
another. That is, a learner has a limited working memory capacity for words and a limit 
for pictures, but “using up” the word limit does not “use up” the picture limit. Therefore, 
Mayer & Moreno (2003) suggest that instructors or designers can “off-load” meaningful 
information from one channel to the other, by using fewer words and more pictures when 
verbal working memory would otherwise be overloaded. Again, this “off-loading” only 
works if the pictures and words directly support each other. Pictures that are interesting 
but irrelevant to the words, containing “seductive details,” can be detrimental by filling 
limited working memory with the irrelevant content (Mayer, 2001). 

The complementary nature of words and moving pictures has been demonstrated 
in a series of studies in which instructional video material was broken into audio and 
silent video components and compared to the full video with audio (see Kozma, 1991, for 
a review). In most cases children learned significantly more from the video-audio 
presentations, and in no case did they learn less. This supports the concept that narrative 
and picture information do not interfere with each other, but instead support each other. 

When both memory systems are in danger of overload, Mayer & Moreno’s (2003) 
research suggests segmentation of combined word-picture content, organizing content in 
“bite-size segments” with opportunities to integrate and organize new information 
between segments (Mayer & Chandler, 2001). 

Embedded multimedia takes advantage of these theoretical principles, combining 
verbal and visual content (words and moving pictures) to give learners multiple pathways 
to retention and comprehension and interspersing “bite-sized segments” with 
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opportunities to practice and apply new learnings. For example, a key problem in early 
reading instruction is teaching associations between letter shapes and letter sounds. The 
embedded multimedia strategy described in this paper contains a series of animations 
designed to link the letter shape and letter sound in a brief, memorable story. In 
introducing the /p/ sound, for instance, a parrot eats some watermelon, and then spits out 
the seeds, making the sound /p/, /p/, /p/. The seeds fall in the shade of the letter “p”. 

This 30-second story, which five-year-olds readily leam and remember, gives them a link 
in their visual memory between the shape “p” and the sound /p/ that they can easily 
access, adding to the verbal and tactile learning the teacher provides by having children 
look at a picture of the parrot in the shape of the letter “p” and having them make the /p/ 
sound and noticing how their lips form when they do so. 

In English reading, children must learn 44 phonemes represented by more than 60 
graphemes (Adams, 1990). In order to quickly and automatically recognize each, and 
avoid confusions among them, children need to practice them separately and in words 
and sentences. Practice in cooperative groups, working with the teacher, and practice in 
other formats, is necessary to solidify learnings from “bite-sized segments,” which is why 
the multimedia segments by themselves are insufficient. 

Similar theories underlie other multimedia applications in beginning reading (see 
Pailliotet & Mosenthal, 2000). To teach sound blending, the present experiment used 
video skits showing puppets sounding out words, creating both visual and auditory 
representations in memory. To teach vocabulary, live-action skits acted out the meanings 
of key words, both in context and then out of context. Again, students were expected to 
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recall the skits (in their visual memories) to gain access to word meanings (needed in 
their verbal memories). 

A key milestone in the development of the embedded multimedia concept was the 
Jasper Project, developed by John Bransford and his colleagues at Vanderbilt University. 
The Jasper Project used videodisc technology to present real-life contexts for 
mathematics problem solving. In well-developed videos, a character named Jasper used 
advanced problem-solving skills to figure out, for example, how much fuel he’d need for 
a motorboat trip. Non-multimedia classroom activities built around the Jasper videodiscs 
enabled teachers to build on the modeling and motivation provided by the videos. 
Although writings about Jasper do not emphasize impacts on the teachers involved, the 
multimedia content must have given teachers a vision of proficient problem solving that 
could have been consequential in their teaching when the videodisc was off. Research on 
the Jasper Project found it to be effective in motivating students and improving their 
mathematics problem solving skills (Cognition and Technology Group at Vanderbilt, 
1996). 

Success for All and Embedded Multimedia 

In 2001, researchers and developers at the nonprofit Success for All Foundation 
and Johns Hopkins University began a project to enhance the Success for All reading 
program with embedded multimedia. Success for All teaches beginning reading using a 
systematic phonics approach. Table 1 summarizes the program’s elements. Fifty 
experimental-control comparisons of one or more years’ duration have found, on average, 
positive effects of Success for All on children’s reading achievement (see Borman, 
Hewes, Overman, & Brown, 2003; Slavin & Madden, 2001; Herman, 1999). 
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Insert Table 1 here 



The addition of embedded multimedia to Success for All’s beginning reading 
program was intended to enhance the effectiveness of the program by giving children 
compelling, memorable demonstrations of letter sounds, sound blending strategies, 
vocabulary, and comprehension strategies. A particular focus was on the needs of 
English language learners, who were felt to be in particular need of visual models for 
vocabulary and sound blending. Further, the multimedia was intended to provide “just in 
time” professional development for teachers, as explained earlier. That is, it was 
expected to model appropriate sound blending strategies, vocabulary presentation 
methods, and instructional strategies. 

A preliminary study of the embedded multimedia strategy was carried out by 
Chambers, Slavin, Madden, Cheung, & Gifford (2004). In that study, four schools 
primarily serving Hispanic students were compared with four matched schools with 
similar demographics and achievement histories. The experimental schools used Success 
for All with embedded multimedia, while the control schools used traditional basal 
approaches. After a one-year implementation, students in the Success for All/Embedded 
Multimedia treatment scored significantly higher than those in the matched control group, 
controlling for Peabody Picture Vocabulary Test pretests, on the Woodcock Word 
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Identification, Word Attack, and Passage Comprehension scales. There were no 
differences on Letter Identification. 

The Chambers et al. (2004) experiment established the combined effect of 
Success for All reading and embedded multimedia on reading achievement, but it did not 
allow for a test of the unique contribution of the embedded multimedia content. 

The Present Study 

The present study builds on the findings of Chambers et al. (2004) study in 
several ways. First, it controlled the instructional content. All schools implemented 
Success for All reading, so that experimental and control schools differed only in the use 
or non-use of the multimedia content. All schools were in the same district, the Hartford 
(CT) Public Schools, further ensuring similarity between experimental and control 
schools on all factors other than the embedded multimedia treatment. In addition, the 
present study randomly assigned schools to the embedded multimedia or control 
treatments. Random assignment eliminates selection bias from the experiment (see 
Mosteller & Boruch, 2003), as all schools had an equal chance of being assigned to the 
experimental or control groups. All school staffs were willing to implement the 
embedded multimedia program; those randomly assigned to the control group were given 
the materials and training in the year following the experiment, as a delayed treatment 
control procedure. 

Use of random assignment to conditions differing only in the provision of the 
embedded multimedia materials provides an experiment high in internal validity. 
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Implementation of the experiment in an inner-city school district over a full school year 
ensures a high degree of external validity. 

Methods 

Design 

This study employed a cluster randomized trial (CRT) design, with random 
assignment of schools to treatments. Ten elementary schools were identified and 
randomly assigned to standard Success for All (control) or Success for All with 
embedded multimedia conditions. 

Participants 

Subjects were 450 first graders, of whom 394 completed pre- and posttests. 
Almost all students qualified for free- or reduced-price lunches, and 62% of students 
were Hispanic and 35% African-American. As indicated in Table 2, the two groups were 
well matched on the percentage of students eligible for free or reduced lunch, ethnicity, 
and the percentage of limited English proficient students in the school. In addition, 
pretests were used to ensure the comparability of the experimental and control schools 
and were used as covariates in the main analyses to adjust for any initial difference 
between the two groups and to increase statistical power. 



Insert Table 2 here 



Treatments 



9 




A. Success for All with Embedded Multimedia . The experimental group used 

multimedia content embedded in teachers’ daily 90-minute Success for All reading 
lessons. This material consisted of 1-3 minute skits and other demonstrations 
integrated with teachers’ lessons. The purpose of the multimedia content was to 
directly present to students compelling demonstrations of key elements of beginning 
reading: letter sounds, sound blending strategies, and vocabulary. In addition, it was 
hoped that by showing multimedia content in class, teachers would have constant 
reinforcement of effective teaching strategies. 

The multimedia materials ultimately created for the program were called Reading 
Reels. Reading Reels includes the following components. 

The Animated Alphabet: Animations that teach and reinforce sound/symbol 
relationships. For example, the animation introducing the short Id sound features an 
elephant pushing a rock with an “e” on it up a hill, making an Id sound with each 
push. At the top, the rock rolls down, and the exhausted elephant says “ehhhh” in 
frustration. The pairing of the memorable images, the letter sound, and the letter 
shape gives students many mental pathways to link the letter with its sound. There 
are animations for 58 different graphemes that comprise most of the phonemes used 
in the English language. Each animation is between 30 seconds and one minute long. 

The Sound and the Furry: Multimedia skits, using SFA puppet characters, 
model the word blending process, phonemic awareness, spelling, fluency, reading 
strategies, and cooperative learning routines. For example, a puppet sees a sign, 
“Watch out for stick.” He sounds out the word “stick” phonetically. Then he notices 
a stick, which he picks up. The stick sticks to his fur, and in trying to get it off he 
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bites it — and then realizes he’s in real trouble. After the skit, the sounding out section 
is repeated, and children sound out the word along with the puppets. More than a 
hundred such vignettes illustrate sound blending strategies from simple CVC words 
to multi- syllable words. The average puppet skit is about two minutes long. 

Word Plays: Live action multimedia skits that dramatize important vocabulary 
concepts from the Success for All beginning reading texts. These skits are 
particularly designed to help English language learners build the specific vocabulary 
for the books they will be reading. For example, when children are about to read a 
story about China, they first see a skit that introduces words such as “chopsticks,” 
“fireworks,” “beautiful,” and “ugly.” The average Word Play is about three minutes 
long. 

Between the Lions: Puppet skits and animations from the award-winning PBS 
program that help teach phonemic awareness, sound/symbol correspondence, and 
sound blending. Between the Lions segments are about one minute long. 

The embedded multimedia materials were developed to be particularly beneficial 
to English language learners. In particular, the vocabulary skits demonstrating the 
vocabulary emphasized in each story children are about to read were designed to 
ensure that all children know the vocabulary in advance so that they can focus on the 
decoding and comprehension tasks required to master and enjoy each book. The 
alphabet and sound-blending segments are also designed to build children’s language 
skills as well as their reading skills. 

B. Control . Control schools used the Success for All reading program without the 
embedded multimedia content. 
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Assessments 



Participants were pretested in early October, 2003, and posttested in early May, 
2004. The pretest was the Peabody Picture Vocabulary Test (PPVT) and the Word 
Identification subtest from the Woodcock Reading Mastery Test-Revised (WMRT-R). 

On average, each testing session took approximately 30 minutes per child. 

The posttests included the reading fluency test from the DIB ELS and three scales 
from the WRMT-R: Word Identification, Word Attack, and Passage Comprehension. 
Testing session required, on average, 42 minute per child. 

The DIB ELS fluency test is a standardized, individually administered test of 
accuracy and fluency with connected text. Student performance is measured by having 
students read a passage aloud for one minute. The Woodcock Word Identification test 
requires the subject to identify isolated words that appear in large type on the subject 
pages in the test book. The Word Attack test requires the subject to read nonsense words 
(letter combinations that are not actual words). The test measures the subject’s ability to 
apply phonic and structural analysis skills in order to pronounce words with which he or 
she is unfamiliar. The Passage Comprehension test measures the subject’s ability to read 
a short passage — usually two to three sentences long — and to identify a key word missing 
from the passage. 

Analyses 

Two forms of analysis were used. One was Hierarchical Linear Modeling (HLM; 
Raudenbush, 1997). HLM is the appropriate analysis for the cluster randomized design 



12 




used in this study, but with only 10 schools, it provides less statistical power than desired. 
For this reason, analyses of covariance were also used to analyze the data. Since 
ANCOVA provides more power than the design justifies, these results should be 
interpreted with caution. In both analyses, condition was the independent variable and 
the WRMT-R subtests and the DIBELS fluency test were the dependent measures. The 
PPVT and the Word ID pretests were used as covariates to adjust for initial differences 
between the treatment and control groups and to increase statistical power. Analyses 
were carried out both for the overall sample and for the Hispanic subsample. 

Results 

Pretests 

Pretests, summarized in Table 3, show that experimental and control schools were 
well-matched on the PPVT, but the control schools scored higher on the Word 
Identification pretest than the experimental schools, with an effect size of -0.35. This is 
statistically significant at the individual level (p< .01) but not at the school level. 



Insert Table 3 here 



Hierarchical Linear Modeling 

For the hierarchical linear analyses, we developed 2-level hierarchical 
models that nested students and their pretest and posttest scores within schools. The fully 
specified level 1, or within-school model, nests students within schools with pretests as 
co variates. The linear model for level 1 model is written as 
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Yij=p 0 j + Pij (pretest) + rij 



Where 

Yij is the expected subtest score of child i in school j (j=l . . . . 10 schools); 

Poj is the mean outcomes in school j after controlling for pretest difference; 
Py is the random level - 1 pretest effect. 

The fully specified level 2 model is written as 

Poj=Soo + Soi (Treatment) + 802 (Mean Pretest) + Uoj 

Pij=8io 



where 

§oo is the mean achievement in the control schools; 

§oi is the treatment effect; 

802 is the school-level mean pretest effect; 

810 is the pooled within-school regression coefficient for the level -1 covariate. 

Because the pretest slope was no different across all schools on all four measures, 
it was treated as fixed at level 2 of the model and no attempt was made to model the 
effect with school-level predictors. 

As indicated in Tables 4 and 5, the experimental group scored significantly higher 
than the control group on the Word Attack subtest. Using the treatment coefficient of 
6.21 for the mean achievement outcome and dividing this value by the unadjusted 
standard deviation for the Word Attack posttest, we estimated the magnitude of this 
school-level effect at ES= +0.47. Although the experimental group also scored higher 
than the control on Word ID (ES=+0.23), Passage Comparison (ES=+0.20), and DIBELS 
(ES=+0.29), these differences were not statistically significant. 



Insert Tables 4 and 5 here 
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Analyses of Covariance 

After adjusting for the initial difference between the treatment and control group, 
individual-level analyses of covariance found that the experimental group outperformed 
the control group on two of the four dependent measures. The experimental group scored 
significantly higher than the control group on the Word Identification subtest, with an 
effect size of +0.15 and a p-value of 0.013. The experimental group also scored 
significantly higher on the Word Attack subtest, with an effect size of +0.32 and a p- 
value of 0.001. Differences on Passage Comprehension (ES=+0.08) and DIBELS 
Reading Fluency (ES= +0.12) were in the same direction, but were not statistically 
significant. 

Hispanic Students 

Analyses for the Hispanic subsample produced results very similar to those of the 
whole sample. No interactions between ethnicity and treatment were found. 

Discussion 

The results of the current study support the expectation that the addition of 
embedded multimedia content to a beginning reading program would enhance children’s 
reading achievement. Schools were randomly assigned to conditions and all schools used 
the same Success for All reading strategies, so the use of embedded multimedia content 
was the only factor differentiating experimental and control conditions. Using the more 
conservative HLM analysis only one of the four outcomes measures, Word Attack, 
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showed significant experimental-control differences, but this is in line with theoretical 
expectations. Three of the four multimedia segments dealt primarily with letter sounds 
and sound blending, which are key components of Word Attack. The fourth. Word Plays, 
focused on vocabulary. The other measures, especially Passage Comprehension and 
DIB ELS, are more logically related to reading of connected text, which was emphasized 
equally in both treatments. 

Because of the use of Word Plays and the visual content in all of the Reading 
Reels materials, it was expected that Hispanic children would benefit disproportionately 
from the embedded multimedia treatment. However, this was not the case. Effects for 
Hispanic children were nearly identical to those for other children (mostly African 
American). However, no measures of English vocabulary were used, and we were unable 
to obtain data on children’s initial English proficiency, so it may be that there were 
undetected effects for the subgroup of children with limited English proficiency. 
Alternatively, in the very impoverished environment involved, it may be that African 
American students also benefited from the Word Plays, which might be expected to build 
their vocabularies in standard English. This issue, effects of embedded multimedia for 
English language learners, is in need of further investigation. 

The findings of the present study and of Chambers et al. (2004) suggest that the 
use of embedded multimedia has significant potential to enhance the effectiveness of 
beginning reading instruction for disadvantaged children. However, much research 
remains to be done to further understand these effects. First, a larger experiment, 
involving at least 40 schools, is needed to provide sufficient statistical power for the 
HLM analysis (Raudenbush, 1997). Such studies should add measurement of vocabulary 
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outcomes for English language learners, to determine impacts for this important 
subgroup. Further, it would be important to study the program’s effects on teachers’ 
practices, to assess the validity of the theory that multimedia modeling of effective 
teaching practices would improve teachers’ implementations of the reading program and 
their overall teaching skill. 

Secondly, smaller-scale studies are needed to examine the separate impacts of the 
multimedia components, and to vary elements of the interventions. Such studies could 
help build a theoretical base for embedded multimedia in reading instruction and suggest 
design principles for further development. 

Research on multimedia learning (e.g., Mayer, 2001) shows that specific design 
elements matter a great deal in determining learning outcomes. However, using design 
principles known to contribute to learning, multimedia embedded in literacy instruction 
may have significant potential to improve reading outcomes for children. 
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Table 1 

Major Elements of Success for All 

Success for All is a schoolwide program for students in grades pre-K to five which organizes 
resources to attempt to ensure that virtually every student will reach the third grade on time with 
adequate basic skills and build on this basis throughout the elementary grades, that no student 
will be allowed to “fall between the cracks.” The main elements of the program are as follows: 



A Schoolwide Curriculum. During reading 
periods, students arc regrouped across age 
lines so that each reading class contains 
students all at one reading level. Use of tutors 
as reading teachers during reading time 
reduces the size of most reading classes to 
about 20. The reading program in grades K-l 
emphasizes language and comprehension 
skills, phonics, sound blending, and use of 
shared stories that students read to one 
another in pairs. The shared stories combine 
teacher-read material with phonetically 
regular student material to teach decoding and 
comprehension in the context of meaningful, 
engaging stories. In grades 2-6, students use 
novels or basals but not workbooks. This 
program emphasizes cooperative learning 
activities built around partner reading, 
identification of characters, settings, 
problems, and problem solutions in narratives, 
story summarization, writing, and direct 
instruction in reading comprehension skills. 
At all levels, students are required to read 
books of their own choice for twenty minutes 
at home each evening. Classroom libraries of 
trade books are provided for this purpose. 
Cooperative learning programs in 
writing/language aits are used in grades K-6. 

Tutors. In grades 1-3, specially trained 
certified teachers and paraprofessionals work 
one-to-one with any students who are failing 
to keep up with their classmates in reading. 
Tutorial instruction is closely coordinated 
with regular classroom instruction. It takes 
place 20 minutes daily during times other than 
reading periods. 



Preschool and Kindergarten. The preschool 
and kindergarten programs in Success for All 
emphasize language development, readiness, 
and self-concept. Preschools and kindergartens 
use thematic units, language development 
activities and a program called Story Telling 
and Retelling (STaR). 

Eight-Week Assessments. Students in grades 1- 
6 arc assessed every eight weeks to determine 
whether they are making adequate progress in 
reading. This information is used to suggest 
alternate teaching strategies in the regular 
classroom, changes in reading group placement, 
provision of tutoring services, or other means of 
meeting students’ needs. 

Family Support Team. A family support team 
works in each school to help support parents in 
ensuring the success of their children, focusing 
on parent education, parent involvement, 
attendance, and student behavior. This team is 
composed of existing or additional staff such as 
parent liaisons, social workers, counselors, and 
vice principals. 

Facilitator. A program facilitator works with 
teachers to help them implement the reading 
program, manages the eight-week assessments, 
assists the family support team, makes sure that 
all staff are communicating with each other, and 
helps the staff as a whole make certain that 
every child is making adequate progress. 
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Table 2 

Demographic Characteristics of Experimental and Control Schools 





Experimental 


Control 


Number of schools 


5 


5 


Number of students 


189 


205 


% free lunch 


99 


95 


Ethnicity: 

% Hispanic 


61 


62 


% African-American 


35 


35 


% White 


4 


2 


% LEP (schoolwide) 


29 


31 
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Table 3 

Pretests (Fall, 2004) 



Experimental (N=189) 



Pretests 


Means 


SD 


PPVT 


86.78 


11.33 


Word ID 


381.74 


27.01 



** pc. 01 (individual-level analysis) 



Control (N=205) 




Means 


SD 


ES 


88.07 


10.44 


-0.12 


390.14 


24.06 


-0.35** 
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Table 4 

Posttests (Spring, 2004) and Analyses of Covariance 





Experimental (N= 


=189) 




Control (N= 


=205) 


ES s 




Post 


SD- 


Adjusted 

Post- 


Post 


SD- 


Adjusted 

Post- 




Word ID 


425.3 


23.0 


428.9 


427.8 


22.5 


424.9 


+0.15* 


Word 

Attack 


480.5 


13.7 


481.7 


478.7 


12.7 


477.6 


+0.32*** 


Passage 

Comp. 


456.5 


15.3 


458.2 


458.6 


15.2 


457.0 


+0.08 


DIB ELS 


29.0 


23.9 


32.1 


32.3 


24.5 


29.4 


+0.12 



a Standard deviation of unadjusted means 
b Adjusted for PPVT and Woodcock Word Identification 

c Effect Size=Adjusted Posttest (exp) - Adjusted Posttest (control)/Unadjusted SD 
(control) 

ANCOVA results 
*p<0.05 

***p<0.001 
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Table 5: Hierarchical Linear Model (HLM) Analyses 



Posttests 
Word ID 



Word Attack 



Passage Comp. 
DIB ELS 



*p<0.05 





Coefficient 


SE 


p-value 


ES 


Intercept 5oo 


427.78 


1.35 


0.000 




Treatment 5 0 i 


5.11 


3.17 


0.151 


+0.23 


Pretest §02 


0.907 


0.22 


0.005 




Intercept 5oo 


480.32 


0.997 


0.000 




Treatment 5oi 


6.21 


2.32 


0.032 


+0.47* 


Pretest 5 0 2 


0.49 


0.16 


0.02 




Intercept 5oo 


458.35 


1.03 


0.000 




Treatment 5oi 


3.04 


2.4 


0.246 


+0.20 


Pretest 802 


0.629 


0.16 


3.761 




Intercept 5 0 o 


31.96 


1.65 


0.000 




Treatment 5oi 


6.95 


3.85 


0.113 


+0.29 


Pretest §02 


1.21 


0.269 


0.003 
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